Visualize Latest Observations from the Ambient Weather Stations

Imports

import glob
import xarray as xr
from bokeh.models.formatters import DatetimeTickFormatter
import hvplot.xarray
import holoviews as hv
from distributed import Client
import warnings

warnings.filterwarnings("ignore")
hv.extension('bokeh')

Start up a Dask Cluster

client = Client()
client

Client

Client-88a45b51-1297-11f0-8afc-7c1e5258f642

Connection method: Cluster object	Cluster type: distributed.LocalCluster
Dashboard: http://127.0.0.1:8787/status

Cluster Info

LocalCluster

fc3a0dde

Dashboard: http://127.0.0.1:8787/status	Workers: 4
Total threads: 4	Total memory: 15.62 GiB
Status: running	Using processes: True

Scheduler Info

Scheduler

Scheduler-5012b320-5010-4a0d-8198-c41a0fa79e24

Comm: tcp://127.0.0.1:33575	Workers: 4
Dashboard: http://127.0.0.1:8787/status	Total threads: 4
Started: Just now	Total memory: 15.62 GiB

Workers

Worker: 0

Comm: tcp://127.0.0.1:38257	Total threads: 1
Dashboard: http://127.0.0.1:43335/status	Memory: 3.90 GiB
Nanny: tcp://127.0.0.1:36285
Local directory: /tmp/dask-scratch-space/worker-j_bvtp1_

Worker: 1

Comm: tcp://127.0.0.1:38255	Total threads: 1
Dashboard: http://127.0.0.1:38073/status	Memory: 3.90 GiB
Nanny: tcp://127.0.0.1:32907
Local directory: /tmp/dask-scratch-space/worker-oz8xxywu

Worker: 2

Comm: tcp://127.0.0.1:37429	Total threads: 1
Dashboard: http://127.0.0.1:46007/status	Memory: 3.90 GiB
Nanny: tcp://127.0.0.1:45673
Local directory: /tmp/dask-scratch-space/worker-klk6xfv4

Worker: 3

Comm: tcp://127.0.0.1:43003	Total threads: 1
Dashboard: http://127.0.0.1:33285/status	Memory: 3.90 GiB
Nanny: tcp://127.0.0.1:39495
Local directory: /tmp/dask-scratch-space/worker-oqmvce5t

Read the Sorted Data, Using the Last File

files = sorted(glob.glob('../../data/surface-meteorology/*/*/*/*.nc'))

ds = xr.open_mfdataset(files[-60:])

---------------------------------------------------------------------------
OSError                                   Traceback (most recent call last)
Cell In[3], line 3
      1 files = sorted(glob.glob('../../data/surface-meteorology/*/*/*/*.nc'))
----> 3 ds = xr.open_mfdataset(files[-60:])

File ~/miniconda3/envs/instrument-cookbooks-dev/lib/python3.10/site-packages/xarray/backends/api.py:1597, in open_mfdataset(paths, chunks, concat_dim, compat, preprocess, engine, data_vars, coords, combine, parallel, join, attrs_file, combine_attrs, **kwargs)
   1594 paths = _find_absolute_paths(paths, engine=engine, **kwargs)
   1596 if not paths:
-> 1597     raise OSError("no files to open")
   1599 paths1d: list[str | ReadBuffer]
   1600 if combine == "nested":

OSError: no files to open

Plot the Data

formatter = DatetimeTickFormatter(hours="%d %b %Y \n %H:%M UTC")

variables = ['outdoor_temperature', 'outdoor_dewpoint', 'hourlyrainin', 'solarradiation']

panels = []
for variable in variables:
    panels.append(ds[variable].hvplot.line(x='time', by='station', xformatter=formatter))
hv.Layout(panels).cols(1)